Response shift, recall bias and their effect on measuring change in health-related quality of life amongst older hospital patients

Background: Assessments of change in subjective patient reported outcomes such as health-related quality of life (HRQoL) are a key component of many clinical and research evaluations. However, conventional longitudinal evaluation of change may not agree with patient perceived change if patients' understanding of the subjective construct under evaluation changes over time (response shift) or if patients' have inaccurate recollection (recall bias). This study examined whether older adults' perception of change is in agreement with conventional longitudinal evaluation of change in their HRQoL over the duration of their hospital stay. It also investigated this level of agreement after adjusting patient perceived change for recall bias that patients may have experienced. Methods: A prospective longitudinal cohort design nested within a larger randomised controlled trial was implemented. 103 hospitalised older adults participated in this investigation at a tertiary hospital facility. The EQ-5D utility and Visual Analogue Scale (VAS) scores were used to evaluate HRQoL. Participants completed EQ-5D reports as soon as they were medically stable (within three days of admission) then again immediately prior to discharge. Three methods of change score calculation were used (conventional change, patient perceived change and patient perceived change adjusted for recall bias). Agreement was primarily investigated using intraclass correlation coefficients (ICC) and limits of agreement. Results: Overall 101 (98%) participants completed both admission and discharge assessments. The mean (SD) age was 73.3 (11.2). The median (IQR) length of stay was 38 (20-60) days. For agreement between conventional longitudinal change and patient perceived change: ICCs were 0.34 and 0.40 for EQ-5D utility and VAS respectively. For agreement between conventional longitudinal change and patient perceived change adjusted for recall bias: ICCs were 0.98 and 0.90 respectively. Discrepancy between conventional longitudinal change and patient perceived change was considered clinically meaningful for 84 (83.2%) of participants, after adjusting for recall bias this reduced to 8 (7.9%). Conclusions: Agreement between conventional change and patient perceived change was not strong. A large proportion of this disagreement could be attributed to recall bias. To overcome the invalidating effect of response shift (on conventional change) and recall bias (on patient perceived change) a method of adjusting patient perceived change for recall bias has been described.

Empirical evidence of recall bias for primary health care visits

BACKGROUND: While it is common for an economic evaluation of health care to rely on trial participants for self-reported health service utilisation, there is variability in the accuracy of this data due to potential recall bias. The aim of this study was to quantify the level of recall bias in self-reported primary health care general practitioner (GP) visits following inpatient rehabilitation over a 12 month period.

METHODS: This report is a secondary analysis from a larger randomised control trial of an economic evaluation of additional Saturday inpatient rehabilitation. Participants were adults who had been discharged into the community following admission to an acute general rehabilitation hospital. Participants were asked to recall primary health care visits, including community GP visits, via a telephone questionnaire which was administered at 6 and 12 months following discharge from inpatient rehabilitation. Participants were asked to recall health service utilisation over each preceding 6 month period. The self-reported data were compared to equivalent claims data from the national insurer, over the same period.

RESULTS: 751 participants (75% of the full trial) with a mean age of 74 years (SD 13) were included in this analysis. Over the 12 month period following discharge from rehabilitation there was an under-reporting of 14% in self-reported health service utilisation for GP visits compared to national insurer claims data over the same period. From 0 to 6 months following discharge from rehabilitation, there was an over-reporting of self-reported GP visits of 35% and from 7 to 12 months there was an under-reporting of self-reported GP visits of 36%, compared to national insurer claims data over the same period. 46% of patients reported the same or one number difference in self-reported GP visits between the 0 to 6 and the 7 to 12 month periods.

CONCLUSION: Based on these findings we recommend that an economic evaluation alongside a clinical trial for an elderly adult rehabilitation population include a sensitivity analysis that inflates self-reported GP visits by 16% over 12 months. However caution is required when utilising self-reported GP visits as the data may contain periods of both over and under reporting. Where general practitioner visits are expected to vary significantly between intervention and control groups we recommend that administrative data be included in the trial to accurately capture resources for an economic evaluation.

Lifetime prevalence estimates of major depression: An indirect estimation method and a quantification of recall bias

The measurement of lifetime prevalence of depression in cross-sectional surveys is biased by recall problems. We estimated it indirectly for two countries using modelling, and quantified the underestimation in the empirical estimate for one. A microsimulation model was used to generate population-based epidemiological measures of depression. We fitted the model to 1-and 12-month prevalence data from the Netherlands Mental Health Survey and Incidence Study (NEMESIS) and the Australian Adult Mental Health and Wellbeing Survey. The lowest proportion of cases ever having an episode in their life is 30% of men and 40% of women, for both countries. This corresponds to a lifetime prevalence of 20 and 30%, respectively, in a cross-sectional setting (aged 15-65). The NEMESIS data were 38% lower than these estimates. We conclude that modelling enabled us to estimate lifetime prevalence of depression indirectly. This method is useful in the absence of direct measurement, but also showed that direct estimates are underestimated by recall bias and by the cross-sectional setting.

Vision, functional and cognitive determinants of motor vehicle incidents in older drivers

Background: The proportion of older individuals in the driving population is predicted to increase in the next 50 years. This has important implications for driving safety as abilities which are important for safe driving, such as vision (which accounts for the majority of the sensory input required for driving), processing ability and cognition have been shown to decline with age. The current methods employed for screening older drivers upon re-licensure are also vision based. This study, which investigated social, behavioural and professional aspects involved with older drivers, aimed to determine: (i) if the current visual standards in place for testing upon re-licensure are effective in reducing the older driver fatality rate in Australia; (ii) if the recommended visual standards are actually implemented as part of the testing procedures by Australian optometrists; and (iii) if there are other non-standardised tests which may be better at predicting the on-road incident-risk (including near misses and minor incidents) in older drivers than those tests recommended in the standards. Methods: For the first phase of the study, state-based age- and gender-stratified numbers of older driver fatalities for 2000-2003 were obtained from the Australian Transportation Safety Bureau database. Poisson regression analyses of fatality rates were considered by renewal frequency and jurisdiction (as separate models), adjusting for possible confounding variables of age, gender and year. For the second phase, all practising optometrists in Australia were surveyed on the vision tests they conduct in consultations relating to driving and their knowledge of vision requirements for older drivers. Finally, for the third phase of the study to investigate determinants of on-road incident risk, a stratified random sample of 600 Brisbane residents aged 60 years and were selected and invited to participate using an introductory letter explaining the project requirements. In order to capture the number and type of road incidents which occurred for each participant over 12 months (including near misses and minor incidents), an important component of the prospective research study was the development and validation of a driving diary. The diary was a tool in which incidents that occurred could be logged at that time (or very close in time to which they occurred) and thus, in comparison with relying on participant memory over time, recall bias of incident occurrence was minimised. Association between all visual tests, cognition and scores obtained for non-standard functional tests with retrospective and prospective incident occurrence was investigated. Results: In the first phase,rivers aged 60-69 years had a 33% lower fatality risk (Rate Ratio [RR] = 0.75, 95% CI 0.32-1.77) in states with vision testing upon re-licensure compared with states with no vision testing upon re-licensure, however, because the CIs are wide, crossing 1.00, this result should be regarded with caution. However, overall fatality rates and fatality rates for those aged 70 years and older (RR=1.17, CI 0.64-2.13) did not differ between states with and without license renewal procedures, indicating no apparent benefit in vision testing legislation. For the second phase of the study, nearly all optometrists measured visual acuity (VA) as part of a vision assessment for re-licensing, however, 20% of optometrists did not perform any visual field (VF) testing and only 20% routinely performed automated VF on older drivers, despite the standards for licensing advocating automated VF as part of the vision standard. This demonstrates the need for more effective communication between the policy makers and those responsible for carrying out the standards. It may also indicate that the overall higher driver fatality rate in jurisdictions with vision testing requirements is resultant as the tests recommended by the standards are only partially being conducted by optometrists. Hence a standardised protocol for the screening of older drivers for re-licensure across the nation must be established. The opinions of Australian optometrists with regard to the responsibility of reporting older drivers who fail to meet the licensing standards highlighted the conflict between maintaining patient confidentiality or upholding public safety. Mandatory reporting requirements of those drivers who fail to reach the standards necessary for driving would minimise potential conflict between the patient and their practitioner, and help maintain patient trust and goodwill. The final phase of the PhD program investigated the efficacy of vision, functional and cognitive tests to discriminate between at-risk and safe older drivers. Nearly 80% of the participants experienced an incident of some form over the prospective 12 months, with the total incident rate being 4.65/10 000 km. Sixty-three percent reported having a near miss and 28% had a minor incident. The results from the prospective diary study indicate that the current vision screening tests (VA and VF) used for re-licensure do not accurately predict older drivers who are at increased odds of having an on-road incident. However, the variation in visual measurements of the cohort was narrow, also affecting the results seen with the visual functon questionnaires. Hence a larger cohort with greater variability should be considered for a future study. A slightly lower cognitive level (as measured with the Mini-Mental State Examination [MMSE]) did show an association with incident involvement as did slower reaction time (RT), however the Useful-Field-of-View (UFOV) provided the most compelling results of the study. Cut-off values of UFOV processing (>23.3ms), divided attention (>113ms), selective attention (>258ms) and overall score (moderate/ high/ very high risk) were effective in determining older drivers at increased odds of having any on-road incident and the occurrence of minor incidents. Discussion: The results have shown that for the 60-69 year age-group, there is a potential benefit in testing vision upon licence renewal. However, overall fatality rates and fatality rates for those aged 70 years and older indicated no benefit in vision testing legislation and suggests a need for inclusion of screening tests which better predict on-road incidents. Although VA is routinely performed by Australian optometrists on older drivers renewing their licence, VF is not. Therefore there is a need for a protocol to be developed and administered which would result in standardised methods conducted throughout the nation for the screening of older drivers upon re-licensure. Communication between the community, policy makers and those conducting the protocol should be maximised. By implementing a standardised screening protocol which incorporates a level of mandatory reporting by the practitioner, the ethical dilemma of breaching patient confidentiality would also be resolved. The tests which should be included in this screening protocol, however, cannot solely be ones which have been implemented in the past. In this investigation, RT, MMSE and UFOV were shown to be better determinants of on-road incidents in older drivers than VA and VF, however, as previously mentioned, there was a lack of variability in visual status within the cohort. Nevertheless, it is the recommendation from this investigation, that subject to appropriate sensitivity and specificity being demonstrated in the future using a cohort with wider variation in vision, functional performance and cognition, these tests of cognition and information processing should be added to the current protocol for the screening of older drivers which may be conducted at licensing centres across the nation.

The influence of psychosocial factors on expectations and persistent symptom report after mild traumatic brain injury

This thesis examines how psychosocial factors influence the report of persistent symptoms after mild traumatic brain injury. Using quasi-experimental methods, the research program demonstrates how factors unrelated to trauma-induced physiological brain damage can contribute to persistent symptoms after a mild traumatic brain injury. The results of this thesis highlight the possibility that outcome from mild traumatic brain injury could be improved by targeting psychosocial factors.

Breast-feeding and childhood-onset type 1 diabetes:A pooled analysis of individual participant data from 43 observational studies

OBJECTIVE: To investigate if there is a reduced risk of type 1 diabetes in children breastfed or exclusively breastfed by performing a pooled analysis with adjustment for recognized confounders.
RESEARCH DESIGN AND METHODS: Relevant studies were identified from literature searches using MEDLINE, Web of Science, and EMBASE. Authors of relevant studies were asked to provide individual participant data or conduct prespecified analyses. Meta-analysis techniques were used to combine odds ratios (ORs) and investigate heterogeneity between studies.
RESULTS: Data were available from 43 studies including 9,874 patients with type 1 diabetes. Overall, there was a reduction in the risk of diabetes after exclusive breast-feeding for >2 weeks (20 studies; OR = 0.75, 95% CI 0.64-0.88), the association after exclusive breast-feeding for >3 months was weaker (30 studies; OR = 0.87, 95% CI 0.75-1.00), and no association was observed after (nonexclusive) breast-feeding for >2 weeks (28 studies; OR = 0.93, 95% CI 0.81-1.07) or >3 months (29 studies; OR = 0.88, 95% CI 0.78-1.00). These associations were all subject to marked heterogeneity (I(2) = 58, 76, 54, and 68%, respectively). In studies with lower risk of bias, the reduced risk after exclusive breast-feeding for >2 weeks remained (12 studies; OR = 0.86, 95% CI 0.75-0.99), and heterogeneity was reduced (I(2) = 0%). Adjustments for potential confounders altered these estimates very little.
CONCLUSIONS: The pooled analysis suggests weak protective associations between exclusive breast-feeding and type 1 diabetes risk. However, these findings are difficult to interpret because of the marked variation in effect and possible biases (particularly recall bias) inherent in the included studies.

Nonsteroidal anti-inflammatory drugs and the esophageal inflammation-metaplasia-adenocarcinoma sequence

Observational studies suggest that nonsteroidal anti-inflammatory drugs (NSAIDs) reduce the risk of esophageal adenocarcinoma, but it is not known at what stage they may act in the esophageal inflammation-metaplasia-adenocarcinoma sequence. In an all-Ireland case-control study, we investigated the relationship between the use of NSAIDs and risk of reflux esophagitis, Barrett's esophagus, and esophageal adenocarcinoma. Patients with esophageal adenocarcinoma, long-segment Barrett's esophagus and population controls were recruited from throughout Ireland. Esophagitis patients were recruited from Northern Ireland only. Data were collected on known and potential risk factors for esophageal adenocarcinoma and on the use of NSAIDs, including aspirin, at least 1 year before interview. Associations between use of NSAIDs and the stages of the esophageal inflammation-metaplasia-adenocarcinoma sequence were estimated by multiple logistic regression. In total, 230 reflux esophagitis, 224 Barrett's esophagus, and 227 esophageal adenocarcinoma and 260 population controls were recruited. Use of aspirin and NSAIDs was associated with a reduced risk of Barrett's esophagus [odds ratio [OR; 95% confidence interval (95% CI)], 0.53 (0.31-0.90) and 0.40 (0.19-0.81), respectively] and esophageal adenocarcinoma [OR (95% CI), 0.57 (0.36-0.93) and 0.58 (0.31-1.08), respectively]. Barrett's esophagus and esophageal adenocarcinoma patients were less likely than controls to have used NSAIDs. Selection or recall bias may explain these results and the results of previous observational studies indicating a protective effect of NSAIDs against esophageal adenocarcinoma. If NSAIDs have a true protective effect on the esophageal inflammation-metaplasia-adenocarcinoma sequence, they may act early in the sequence.

Affective Instability, Childhood Trauma and Major Affective Disorders

BACKGROUND: Affective instability (AI), childhood trauma, and mental illness are linked, but evidence in affective disorders is limited, despite both AI and childhood trauma being associated with poorer outcomes. Aims were to compare AI levels in bipolar disorder I (BPI) and II (BPII), and major depressive disorder recurrent (MDDR), and to examine the association of AI and childhood trauma within each diagnostic group. METHODS: AI, measured using the Affective Lability Scale (ALS), was compared between people with DSM-IV BPI (n=923), BPII (n=363) and MDDR (n=207) accounting for confounders and current mood. Regression modelling was used to examine the association between AI and childhood traumas in each diagnostic group. RESULTS: ALS scores in descending order were BPII, BPI, MDDR, and differences between groups were significant (p<0.05). Within the BPI group any childhood abuse (p=0.021), childhood physical abuse (p=0.003) and the death of a close friend in childhood (p=0.002) were significantly associated with higher ALS score but no association was found between childhood trauma and AI in BPII and MDDR. LIMITATIONS: The ALS is a self-report scale and is subject to retrospective recall bias. CONCLUSIONS: AI is an important dimension in bipolar disorder independent of current mood state. There is a strong link between childhood traumatic events and AI levels in BPI and this may be one way in which exposure and disorder are linked. Clinical interventions targeting AI in people who have suffered significant childhood trauma could potentially change the clinical course of bipolar disorder.

Tests of measurement invariance failed to support the application of the "then-test"

Objective
The use of then-test (retrospective pre-test) scores has frequently been proposed as a solution to potential confounding of change scores because of response shift, as it is assumed that then-test and post-test responses are provided from the same perspective. However, this assumption has not been formally tested using robust quantitative methods. The aim of this study was to compare the psychometric performance of then-test/post-test with traditional pre-test/post-test data and assessing whether the resulting data structures support the application of the then-test for evaluations of chronic disease self-management interventions.

Study Design and Setting
Pre-test, post-test, and then-test data were collected from 314 participants of self-management courses using the Health Education Impact Questionnaire (heiQ). The derived change scores (pre-test/post-test; then-test/post-test) were examined for their psychometric performance using tests of measurement invariance.

Results
Few questionnaire items were noninvariant across pre-test/post-test, with four items identified and requiring removal to enable an unbiased comparison of factor means. In contrast, 12 items were identified and required removal in then-test/post-test data to avoid biased change score estimates.

Conclusion
Traditional pre-test/post-test data appear to be robust with little indication of response shift. In contrast, the weaker psychometric performance of then-test/post-test data suggests psychometric flaws that may be the result of implicit theory of change, social desirability, and recall bias.

Leptin in depressed women : Cross-sectional and longitudinal data from an epidemiologic study

Background There is conflicting evidence regarding levels of leptin in depression. In this study we aimed to investigate the relationship between serum leptin level and depression in a community sample of women using both cross-sectional and longitudinal data.

Methods From among 510 women aged 20–78 yr, 83 were identified with a lifetime history of major depressive disorder or dysthymia, ascertained using the Structured Clinical Interview for DSM-IV-TR Research Version, Non-patient edition (SCID-I/NP). Serum leptin levels were measured by radioimmunoassay. Medication use and lifestyle were self-reported and body mass index (BMI) determined from measures of height and weight.

Results Using multiple linear regression, serum leptin levels were greater among women with a lifetime history of depression compared to women without any history of depression, independent of BMI. Adjusted geometric mean values of serum leptin were 16.37 (95%CI 14.70–18.23) ng/mL for depressed and 14.46 (95%CI 13.79–15.16) ng/mL for non-depressed women (P = 0.039). The hazard ratio (HR) for a de novo depressive disorder over five years increased 2.56-fold for each standard deviation increase in log-transformed serum leptin among non-smokers and this was not explained by differences in BMI, medications or other lifestyle factors (HR = 2.56, 95%CI 1.52-4.30). No association was observed for smokers.

Limitations There is potential for unrecognised confounding, recall bias and transient changes in body composition.

Conclusion Women with a lifetime history of depression have elevated levels of serum leptin, and elevated serum leptin predicts subsequent development of a depressive disorder.

Does reverse causality explain the relationship between diet and depression?

BACKGROUND: Observational studies have repeatedly demonstrated relationships between habitual diet quality and depression. However, whilst reverse causality has not been the identified mechanism for these associations in prospective studies, the relationship between diet and depression is likely complex and bidirectional. Thus explicit investigation of the reverse causality hypothesis is warranted. METHODS: Data were drawn from the Personality and Total Health (PATH) Through Life Study, a longitudinal community survey following three age cohorts from Australia. Analyses evaluated the relationships between past depression and treatment, current depressive symptoms and dietary patterns. RESULTS: Individuals with current depression had lower scores on a healthy dietary pattern; however, those who had been previously depressed and sought treatment had higher scores on the healthy dietary pattern at the later baseline assessment. Moreover, those who had reported prior, but not current, depression also had lower scores on the western dietary pattern than those without prior depression, regardless of whether they had been previously treated for their symptoms. LIMITATIONS: Self-report data and possible recall bias limit our conclusions. CONCLUSIONS: In this study, prior depression was associated with better quality diets at the later time point. Thus, while current depression is associated with poorer dietary habits, a history of depression may prompt healthier dietary behaviours in the long term. Given the demonstrated relationships between diet quality and depressive illness, clinicians should advocate dietary improvement for their patients with depression and should not be pessimistic about the likelihood of adherence to such recommendations.

Depression as a risk factor for fracture in women: a 10 year longitudinal study

BACKGROUND: Previous research has demonstrated deficits in bone mineral density (BMD) among individuals with depression. While reduced BMD is a known risk for fracture, a direct link between depression and fracture risk is yet to be confirmed. METHODS: A population-based sample of women participating in the Geelong Osteoporosis Study was studied using both nested case-control and retrospective cohort study designs. A lifetime history of depression was identified using a semi-structured clinical interview (SCID-I/NP). Incident fractures were identified from radiological reports and BMD was measured at the femoral neck using dual energy absorptiometry. Anthropometry was measured and information on medication use and lifestyle factors was obtained via questionnaire. RESULTS: Among 179 cases with incident fracture and 914 controls, depression was associated with increased odds of fracture (adjusted odds ratio (OR) 1.57, 95%CI 1.04-2.38); further adjustment for psychotropic medication use appeared to attenuate this association (adjusted OR 1.52, 95%CI 0.98-2.36). Among 165 women with a history of depression at baseline and 693 who had no history of depression, depression was associated with a 68% increased risk of incident fracture (adjusted hazard ratio (HR) 1.68, 95%CI 1.02-2.76), with further adjustment for psychotropic medication use also appearing to attenuate this association (adjusted HR 1.58, 95%CI 0.95-2.61). LIMITATIONS: Potential limitations include recall bias, unrecognised confounding and generalizability. CONCLUSIONS: This study provides both cross-sectional and longitudinal evidence to suggest that clinical depression is a risk factor for radiologically-confirmed incident fracture, independent of a number of known risk factors. If there is indeed a clinically meaningful co-morbidity between mental and bone health, potentially worsened by psychotropic medications, the issue of screening at-risk populations needs to become a priority.

Social phobia in obsessive-compulsive disorder: Prevalence and correlates

Fundação de Amparo à Pesquisa do Estado de São Paulo (FAPESP)

Análise do viés de recordação de informações sobre lesões no futebol em adolescentes

Pós-graduação em Fisioterapia - FCT

Social phobia in obsessive-compulsive disorder: Prevalence and correlates

Background: Social Phobia (SP) is an anxiety disorder that frequently co-occurs with obsessive-compulsive disorder (OCD); however, studies that evaluate clinical factors associated with this specific comorbidity are rare. The aim was to estimate the prevalence of SP in a large multicenter sample of OCD patients and compare the characteristics of individuals with and without SP. Method: A cross-sectional study with 1001 patients of the Brazilian Research Consortium on Obsessive-Compulsive Spectrum Disorders using several assessment instruments, including the Dimensional Yale-Brown Obsessive-Compulsive Scale and the Structured Clinical Interview for DSM-IV Axis I Disorders. Univariate analyses were followed by logistic regression. Results: Lifetime prevalence of SP was 34.6% (N=346). The following variables remained associated with SP comorbidity after logistic regression: male sex, lower socioeconomic status, body dysmorphic disorder, specific phobia, dysthymia, generalized anxiety disorder, agoraphobia, Tourette syndrome and binge eating disorder. Limitations: The cross-sectional design does not permit the inference of causal relationships; some retrospective information may have been subject to recall bias; all patients were being treated in tertiary services, therefore generalization of the results to other samples of OCD sufferers should be cautious. Despite the large sample size, some hypotheses may not have been confirmed due to the small number of cases with these characteristics (type 2 error). Conclusion: SP is frequent among OCD patients and co-occurs with other disorders that have common phenomenological features. These findings have important implications for clinical practice, indicating the need for broader treatment approaches for individuals with this profile. (C) 2012 Elsevier B.V. All rights reserved.